WO 2004/044741 



10/529 087 
Rec'd m/m 24 MAR 2005 

^^CT/US2003/030627 



1/9 



LACE 



113 



Calibration 
Module 



115 



V 



Multilingual 
^ DB _ 



Translation 
Module 



116 



Display 
Module 



100 



110 



CPU 


y ioi ; 




\f 102 » 


RAM 




jy- 103 ! 


I/O 




If ' 


OS 






MC 



109 
108 



112 



1 Screen ■ 
I Scraping ! 




118 



117 ! 



Callout 




Language 


Setting 




Setting 



V 



Living History 




119 



is the book titled Living Hisiajy written by H. Clinton ... 

n f^--K> •' 

User's Screen 



FIG. 1A 



WO 2004/044741 



10/529 087 



CT/US2003/030627 



2/9 



Activate LACE 



Select a subject language 



y 



Screen-scrape a segment of text 



i 



Calibrate the scraped into a query 



Translate the query into the 
selected subject language 



y 



Wrap the query and the annotation 



Display the wrapped in a callout 



Change callout setting 



121 
122 

123 

124 

125 

126 

127 
128 



FIG. 1B 



WO 2004/044741 



BEST AVAILABLE COPY 



3/9 



10/529 087 



CT/US2003/030627 



214 



211 




213 



212 



FIG. 2A 



WO 2004/044741 



m, 



10/529 087 



CT/US2003/030627 



4/9 



r 



228 



Display the 
annotation 
contained in a 
callout on the 
user's screen 
according to a 
signal sent from 
the server 



User Side 



Visit a LACE enabled web site 



Activate LACE from the site 



Select a subject language 



if 



221 
222 
223 



S 



Site Server Side 



Screen-scrape a segment of text 

I 



Calibrate the screen-scraped text 



Translate the query (the calibrated) 
into the selected subject language 



224 
225 
226 



1 




Return the bilingual annotation with 
metadata 



227 



FIG. 2B 



WO 2004/044741 

BEST AVAILABLE COPY 



^LO/529087 

^^CT/US2003/030627 



Multilingual LACE 



1 Select Language T 




Arabian 




IHill 

French 




German 




Japanese 




Korean 




Russian 




• 




• 




• 



FIG. 2C 



5/9 

Multilingual LACE 

Arabian I 

French i 

German ; 

Korean \ 
Russian 

FIG. 2D 



FIG. 2E 



Port of Oajcfepd 




Port of Oakland 



Port of o Oakland 




10/529087 

WO 2004/044741 ^^CTAJS2003/030627 



6/9 



240 



LACE on Web Server 



Calibration 
Module 



I 



243 



244 



245 





Translation 






Module 








s 


246 




Callout 
Module 



Multilingual 
DB 



J 



HTTP 



"I 
1 

• j 



250 



. -A 

« Screen i 
i Scraping 



242 



248 



Callout 
Setting 




249 



247 



Language 
Setting 



241 



Port of Oakland 



Web Page on User's Screen 



FIG. 2G 




FIG. 2H 



WO 2004/044741 



BEST AVAILABLE COPY 



10/529 0 



CT/US2003/030627 



8/9 




. Solution 1 

1 Solution 2 
Audience Chart 
qN Expertise 
Case Studies 

: Clients 

i Site Map 



qN Site Server 



FIG. 3A 




310 



IM Session 



10/529087 

WO 2004/044741 ^^CT/US2003/030627 

BEST AVAILABLE COPY 



9/9 



Log on (activate) IM_LACE 



| Screen-scrape asegment of text 



Calibrate the screen-scraped text 



Send a query to the central server 



Return to the client a bilingual 
annotation on the query 



Display the annotation in a callout 



321 
322 
323 
324 

325 
326 



FIG. 3B 



